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PROJECT DESCRIPTION 


Since July 2014, The Franklin Institute (TFI) 
has offered professional learning 
experiences for teachers, principals, 
superintendents, and out-of-school time 
educators that focus on topics related to 
the brain and learning. TFI has partnered 
with several school districts and 
educational organizations in the tri-state 
area (PA, NJ, & DE) to reach a broad range 
of educators and administrators to 
communicate that understanding the brain 
is critical in order to effectively educate 
children across ages and settings. 


GOALS AND 
OBJECTIVES OF 
BRAIN PD 


In 2016 and 2017, Audience Focus (AF) 
conducted a summative evaluation to 
measure the impact of the program on 
participants. The summative evaluation 
investigated 3 key questions: 1) How are 
classroom teachers and school/district 
administrators impacted by their 
participation in Brain PD?, 2) What do 
classroom teachers and school/district 
administrators perceive are the impacts of 
Brain PD for educators on student 
learning?, and 3) What components of the 
Brain PD model do target audiences 
perceive contribute most to the program's 
impacts? 


The primary outcomes articulated by TFI 
for program participants are to: 1) increase 
understanding about how the brain works 
related to learning and memory, 

2) increase understanding of teaching 
strategies supported by brain research, 3) 
change beliefs about how students learn to 
be more aligned with brain research, 4) 
change teaching practice in the classroom 
to embody strategies that are supported by 
brain research, 5) change administrative 
decisions in their schools/districts, and 6) 
increase interest in using learning 
strategies supported by brain research in 
their professional work. 








EVALUATION PLAN 


IN 2016-2017 AUDIENCE FOCUS CONDUCTED THREE SEPARATE, BUT 
RELATED, INVESTIGATIONS TO MEASURE THE IMPACT OF BRAIN PD ON 
SCHOOL ADMINISTRATORS & TEACHERS. 
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The first evaluation was a quasi- 
experimental, retrospective pre/post 
study that measured program impacts 
on teachers and administrators who 
participated in Brain PD before May of 
2016. The second study was launched 
the following year using a quasi- 
experimental pre/post design to 
measure program impacts on teachers 
who participated in the program 
during the 2016-2017 program year. 
Finally, a third, qualitative study was 
conducted as a way to document 
teachers' and school/district 
administrators' perceptions of the 
program's impacts in greater depth. 





A TOTAL OF 405 TEACHERS 
AND ADMINISTRATORS 
PARTICIPATED IN THE 
EVALUATION STUDY: 255 
TEACHERS AND 
ADMINISTRATORS 
PARTICIPATED IN THE 
RETROSPECTIVE PRE/POST 
STUDY; 121 PARTICIPATED IN 
THE PRE/POST STUDY; AND, 
29 PARTICIPATED IN THE 
QUALITATIVE STUDY. 
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IMPACTS ON TEACHERS 


FINDINGS SHOW THAT BRAIN PD HAS SIGNIFICANT, POSITIVE 
IMPACT ON TEACHERS' AND ADMINISTRATORS' KNOWLEDGE, 
AWARENESS, PRACTICES, BELIEFS, AND INTERESTS RELATED 
TO THE BRAIN AND LEARNING 





In both the retrospective 
pre/post and the pre/post 
studies, teachers rated a series 
of scaled items designed to 
measure program impacts. In 
each case, teachers rated their: 
1) understanding of how the 
brain learns, 2) interest in 
learning more about how the 
brain learns, 3) awareness and 
use teaching strategies 
supported by brain research 
and 4) beliefs about how 
students learn to be more 
aligned with how the brain 
learns significantly higher after 
participating in Brain PD than 
before. (See Table 1 below) 


Impact Category 





Interest in learning more 5.73 
about how the brain learns 


Understanding of how the 3.66 
brain learns 

Awareness of brain 3.99 
teaching strategies scale* 

Use of teaching strategies 3.63 


supported by neuroscience 
research in the classroom 
scale* 


Beliefs about how students 4.2] 


learn scale” 


Table 1: Teachers' pre post ratings of program impacts. Interest and understanding 


Through qualitative lines of 
inquiry, participants spoke in 
depth about the many ways 
participating in TFl’s Brain PD 
positively impacted them, 
reinforcing findings from the 
quantitative studies. Results 
from the qualitative study 
indicate participants believe 
their participation in Brain 
PD increases their awareness 
and understanding of how 
the brain works related to 
learning, challenges and 
expands their beliefs about 
how children learn, and 
changes the way they 
approach learning in their 
classrooms. 


Significant 





6.13 +0.4 Y 
5.39 *1.7 Y 
4.26 +0.3 Y 
4.01 +0.4 Y 
4.56 +0.4 Y 


used a 7 point scale, where 1l=low end and 7-high end. Awareness of teaching 


strategies, use of teaching strategies, and beliefs about how students learn based on a 


5-point scale, where 1=low end and 5-high end. Data is from pre / post study. 
*Individual items for scales available upon request. 


In the retrospective pre/post study, administrators also rated a 
series of items designed to measure program impacts using a 
5-point scale, with l=strongly disagree and 5=strongly agree. 
For each item, administrators rated their: 1) understanding of 
how the brain learns, 2) interest in learning more about how 
the brain learns, 5) awareness and use teaching strategies 
supported by neuroscience research and 4) beliefs about how 
students learn to be more aligned with brain science 
significantly higher after participating in Brain PD than 
before. Administrators also rated scale items designed to 
measure their use of learning strategies supported by brain 
research to inform key school/decision making significantly 
higher after the program than before. (See Table 2) 


[ee Strategy Change | Significance 
n Mad 


Use of Brain-Based Leaming to Inform 
Decision-making Scale 





4.0 0 +0 0.9 


| encourage teachers to demonstrate a | 
growth mindset with students 3.6 4.6 +1.0 Y 
| organize professional development, 
meetings, or discussions around brain- 2.6 3.7 +].] Y 
based learning 


| evaluate teachers' use of brain-based 


teaching strategies in their classrooms 2.3 3.4 +|.| i 


| am flexible in my expectations of how 
much curricula teachers cover in a given 2.9 3.7 *0.8 Y 
period of time 


I support the idea that students' 
placement/tracking (advanced vs. 
remedial, gifted, special education) can 
change throughout their school career 


3.8 4.4 +0.6 Y 


| placed a high value on other forms of 

assessment like projects and 37 43 
presentations to evaluate student ງ 
learning 


*0.6 N 


Table 2: Administrators' ratings of ways Brain PD influenced their 
administrative decision making (data is from retrospective pre/post 
study) 





IMPACTS ON TEACHERS 


a ADMINISTRATORS 


Increased Awareness & Understanding 


Teachers and school/district administrators clearly indicate that 
Brain PD increases or reinforces their understanding of how the 
brain works related to learning, as well as their understanding 
of teaching strategies aligned with how the brain learns, like 
providing active and sensory learning experiences, activating 
prior knowledge and interests, and demonstrating growth 
mindset. School/district administrators, in particular, say having 
an increased understanding of the how the brain works and 
sound evidence to back brain-based strategies and learning 
theories allows them to communicate more clearly with 
classroom educators and to push harder for the adoption of 
strategies supported by neuroscience research in the 
classroom. 





"I THINK THIS IS GROUND 
BREAKING. IT'S UNIQUE TO 
THE CLASSROOM AND I AM 
SEEING TREMENDOUS 
RESULTS IN THE CLASSROOM 
AS A RESULT OF THIS. THE 
KIDS ARE PERFORMING AT 
LEVELS THAT I HAVE NEVER 
SEEN BEFORE." 


Changes in Attitudes & Beliefs 


"BEFORE I WAS REALLY 
CONCERNED WITH THE 
LESSON PLAN, VERY 
CONCERNED WITH MAKING 
SURE I MET DISTRICT GOALS. 
NOW AFTER THE BRAIN PD I 
THINK 'HOW CAN I MAKE 
THIS CONTENT FIT FOR MY 
STUDENTS?’ I AM PUTTING 
MY STUDENTS FIRST MORE 
THAN I HAVE EVER DONE 
BEFORE, BASED ON THIS 
RESEARCH." 


co u-—————— ae 
Changes in Professional Practice 


Teachers say they are implementing teaching and learning 
strategies that are aligned with how the brain learns into their 
classrooms. Strategies that educators say they are incorporating 
with more frequency include: activating students' prior 
knowledge, curiosity, and interests; providing more opportunities 
for students to engage in active and sensory learning; giving 
students brain breaks; emphasizing growth mindset by teaching 
students how their brains work and referencing growth mindset 
in language; and, providing more opportunities for students to 
go deeper into one topic and/or stimulate higher-order thinking 
skills. Most administrators say they now offer additional PD and 
foster ongoing conversations related to the brain and learning 
with their staff. Some say they now incorporate evidence of brain 
research teaching strategies into classroom evaluation tools, 
have modified the curriculum, and/or have new expectations for 
assessment and pacing. 


Teachers and administrators eloquently describe ways that 
participation in Brain PD leads to greater open-mindedness and 
empathy towards students and their learning needs. Participants 
describe beliefs that are more clearly aligned with growth mindset, 
especially the notion that all people learn differently, that intelligence 
can grow and change over time, and that young people should be 
treated according to their brain development. Some say participating 
in Brain PD changes how they prioritize students’ needs over externally 
mandated goals and testing. strategies. 


"BEFORE I WAS MORE 
TEACHER-DIRECTED, 
TEACHER FOCUSED, AND 
NOW I AM MORE STUDENT- 
FOCUSED. I HAVE MY 
STUDENTS BECOMING MORE 
OF AN EXPLORER AND 
TRYING TO CREATE AND 
CONSTRUCT THEIR 
LEARNING, AND BE THE 
GUIDE ON THE SIDE INSTEAD 
OF THE PERSON UP FRONT 
TEACHING EVERYTHING.” 
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IMPACTS ON SCHOOL 
CULTURE 


Through the pre/post study, teachers reported positive 
significant changes in the degree to which teachers, 
administrators, and students talk about research on the brain 
and growth mindset in their schools. (See Table 3) In addition, 
many teachers and school/district administrators who 
participated in the qualitative study describe the ways 
participating in Brain PD influences their beliefs about student 
learning and the decisions being made at a district-wide level. 
Administrators describe increased communication and 
dialogue about how the brain works and growth mindset 
among faculty at all levels, as well as more systemic changes 
to lesson-planning and curriculum development that will now 
incorporate more brain-based strategies to improve student 
learning. 


Changes in school culture 


In general, my school is supportive of 
using brain-based learning approaches 3.69 4.49 *0.8 Y 
in the classroom 


Teachers talk about Brain-based 
learning strategies in my school 


Teachers talk about Growth Mindset in 
my school 


3.13 4.2] *1.1 Y 


3.21 4.28 *1.1 Y 


School or district administrators talk 
about how the brain works or using 3.25 4.28 *1.0 Y 
brain-based strategies 


School or district administrators talk 


about Growth Mindset 3.29 4.34 +!.| Y 
Students talk about how their brains 2.39 3.5] ຈາ Y 
work 

Students talk about Growth Mindset, or 

how their brains can change over time 2.47 3.7] +1.2 Y 


Table 3: Teachers' ratings of ways Brain PD influenced school culture using a5 
point scale where 1=low end and 5=high end. Data come from pre/post study; 
however, retrospective pre/post scale was used for this question as many of 
the statements were not asked on the baseline. Statements were revised to 
be more in line with TFI's indicators for this impact following the results from 
the qualitative study 





IMPACTS ON STUDENT LEARNING 


FINDINGS RELATED TO THE IMPACT OF BRAIN PD ON STUDENT 
LEARNING ARE LESS CONSISTENT BETWEEN THE THREE STUDIES. 


While teachers and administrators who participated in the retrospective pre/post and true pre/post 
studies say they believe students benefit indirectly as teachers improve their teaching practice 
and/or become more empathetic towards students, most struggle to describe direct, concrete 
benefits for students. Many administrators, in particular, say they are unsure how students benefit 
and that “only time will tell.” Classroom educators who participated in the qualitative study, on 
the other hand, strongly believe their participation in Brain PD impacts students and were able to 
articulate those benefits in the following ways: 


Increased Interest & Engagement 


Teachers say students are demonstrating more interest and 
engagement in learning since they have incorporated teaching 
strategies supported by neuroscience in their classroom. 
Educators say when they tap into students’ prior experiences 
and interests, provide more active and sensory learning 
experiences, and differentiate learning based on individual 
student needs, students noticeably become more engaged in 


their learning. 


"IT’S PRETTY IMPRESSIVE 
THAT AFTER 2 YEARS OF 
BEING INVOLVED WITH THIS 
YOU COULD WALK INTO MY 
ROOM AND ANY ONE OF MY 
KIDS FROM THE LOWEST TO 
HIGHEST COULD TELL YOU 
WHAT GROWTH MINDSET IS. 
WE MAKE IT JUST AS 
IMPORTANT AS READING, 
MATH, WRITING AND THEY 
ARE ONLY 6" 


"IF STUDENTS ARE 
INTRIGUED AND THE BRAIN 
IS CURIOUS IT IS GOING TO 
WANT TO LEARN, IT IS GOING 
TO WANT MORE 
INFORMATION. I AM SEEING 
GREAT RESULTS." 


Increased Awareness & Understanding 


Teachers say that many students are more aware of and 
interested in the ways their brains work and what growth 
mindset is as a result of Brain PD. Educators are more likely to 
share information about the brain with students after 
participating in the program, which translates into greater 
awareness and understanding of, and interest in the brain 


among students. 


Increased Confidence & Perseverance 


Teachers and a few school/district administrators report 
increased confidence in students to persevere in the face of 
learning challenges as a result of the growth mindset approach 
adopted in classrooms following the Brain PD. Educators say 
they have heard students using more positive language when 
talking about their own or their peers’ learning abilities and have 
also seen students improve on assessment scores, which they 
attribute to the introduction of growth mindset in their 


classrooms. 





"I HAVE HAD, BECAUSE OF 
PARTICIPATION IN THE 
BRIAN PD, 3 STUDENTS WHO 
HAVE NEVER RECEIVED 
STRAIGHT A’S IN THEIR 
ENTIRE ELEMENTARY 
CAREER, NEVER, THEY GOT 
STRAIGHT A’S THIS MARKING 
PERIOD. ALL 3 SIGHTED "IT 
IS BECAUSE OF HOW MY 
BRAIN WORKS. I FOUND OUT 
HOW MY BRAIN WORKS AND 
I AM USING IT IN CLASSES 
AND I AM DOING VERY 
WELL." 


THROUGH THE QUALITATIVE STUDY, CLASSROOM EDUCATORS AND 
SCHOOL/DISTRICT ADMINISTRATORS IDENTIFIED SIX CORE 
COMPONENTS THAT THEY FEEL CONTRIBUTE MOST TO THE BRAIN PD 
PROGRAM'S IMPACTS. 





Research-based  !e83chers and administrators deeply value hearing from experts and 


Immediately 
Applicable 


Museum-based 
Learning 
Environment 


learning new information about the brain that is grounded in 
research. Participants also value having previously held beliefs 
questioned and common misconceptions dispelled. 


Teachers and administrators agree that learning how to translate 
brain research into practical classroom strategies and activities to 
improve student learning is one of the most valuable aspects of the 
Brain PD model. Both audiences praise the Brain PD for providing 
concrete and immediately applicable ways for brain theory to be 
translated into action. 


Teachers and administrators strongly value the museum-based 
learning context. Participants say being at the museum is a welcome 
change of pace and scenery and helps stimulate interest and curiosity, 
as well as increase concentration and focus. Participants say that 
learning about the brain first and exploring the “Your Brain” exhibit 
second makes the learning more relevant and applicable. 





STRENGTHS OF PROGRAM MODEL 


Component 





Learner- Teachers and school/district administrators clearly value the learner- 


centered facilitation approach used by TFI educators during the Brain 


centered PD. Participants appreciate having opportunities to participate in 
hands-on activities, explore the “Your Brain” exhibit, and “take on the 
role of’ a learner. 





Participants say they appreciate having opportunities to learn with 
school and district colleagues. Benefits of the collaborative model 
include having opportunities to share ideas and implementation 
strategies, as well as leaving the program with a shared language 
and vision. 


Collaborative 





Individualized Teachers and administrators say they appreciate the way TFI creates 
learning experiences that are tailored to the individual interests and 


Experience needs of each partner. 





In the future, classroom educators and school/administrators suggest TFI provide follow-up 
workshops and “deeper dives” for Brain PD participants. In addition to offering subsequent 
PD sessions, participants also say providing regular updates on brain research and offering 
periodic check-ins with PD alumni through oncsite visits, e-mail, or other online 
communication would be welcomed additions to the program. Several educators and 
administrators say the program should be offered to educators and administrators in their 
schools or districts who have not yet participated. Some classroom educators and 
school/district administrators would like to see TFI incorporate even more opportunities to 
learn specific, brain-based teaching strategies that can be implemented in the classroom. 
Some suggest having customizable experiences based on the needs of the school or district. 
Finally, a couple school/district administrators suggest offering more opportunities for 
experienced teachers to take leadership roles in future Brain PD sessions. 
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The Franklin Institute is deeply grateful for the participation 
and collaboration of teachers and administrators who have 
helped to shape this initiative since 2014, and contributed to 
the evaluation study. 


Thank you to our incredible partners from Centennial School 
District, Unionville-Chadds Ford School District, Bensalem 
Township School District, Ridley School District, and Mount 
Laurel School District for their ongoing commitment to using 
research on the brain to improve education. A special thanks to 
Dr. David Baugh for co-designing our first district-wide 
partnership committed to understanding the brain and 
learning for K-12 educators and administrators. 


